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ABSTRACT 

In a review of statewide plans for assessing student 
learning at institutions of higher education, this paper argues that 
assessment, carefully planned to focus on students, can lead to an 
improvement in the communication and understanding between the 
academy and the polity. A brief section on the role of statewide 
assessment places it in a historical and legal context. A section on 
the research and its findings concludes that assessment is most 
useful if efforts are clearly centered on students by identifying 
subgroups of students who profit from their studies, identifying 
aspects of their experience, and by understanding how these provide 
enlightenment, engagement, and empowerment. The next section argues 
tha funding formulas and budget request and decentralized assessment 
approaches have made institutions, rather than students, the primary 
object of analysis. The solution is formative assessment that 
documents how resources devoted to each major subgroup of students 
are paying off. Allocation of resources can then be made in terms of 
the proportion of any one student group served by each institution. 
The next section, on statewide initiatives, describes the Oregon 
state system of higher education's new statewide assessment that 
focuses on common learning criteria and assessment at multiple points 
in time. A Utah effort is also briefly described. (Contains 19 
references.) (JB) 
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Putting Students at the Center of Statewide Assessment 



Why Statewide Assessment 



Some would sav that assessment began with statewide mtt.atives. While 
institutions such ^ Alvemo College, the University of Tennessee at Knoxville and 
Northeast Missouri State University gained national recognition for their mdividua 
institutional efforts in the 1980s, statewide initiatives have played a fundamental 
role in stimulating the attention given to assessment. Organizations representing the 
educational interests of the states, such as the National Governors' Association 
(NGA) (Alexander, Clinton & Kean, 1991) and the Education Commission of the 
States (ECS) (1986), together with reports, such as Involvement in Learning 
(1984) and Integrity in the College Curriculum (1985) fostered discussion among 
legislators and governors and resulted in such statewide initiatives (Sims, 1992). 

Statewide initiatives in assessment often have been viewed negatively because they 
frequcritly are seen as an intrusion on academic freedom or institutional autonomy. 
They are presumed to lead to standardized testing, "dubbing down^ the educational 
program to the lowest ability students, and "teaching to the test." 

Conventional wisdom says that assessment at the instimtional level is good; 
assessment at the state level is a threat. This view began during the 980s when 
most institutions implemented assessments of studem learning as a result of outside 
pressure from state government or an accrediting agency. By 1990, all six regional 
accrediting agencies and 4 out of 5 state governments had taken some action to 
stimulate institutions to implemem studem assessmem programs (Banta, 1993). 
People are quick to poim to the "tyranny" and "intrusion on autonomy that state 
level assessmem poses. However, state-level assessment can be used to the 
advantage of higher education to gamer public support. 

Because Tennessee was the first state to adopt a studem assessmem Po]jcy (in 
1979) and because that policy involved statewide standardized testmg and funding 
based on the results of the assessments, statewide assessment initiatives became 
associated with standardized testing and with direct links to government funding 
formulas. 

With far less attemion, Virginia put forward a statewide assessmem policy in 1985 
that allowed institutions to select the criteria, methods and measures for 
assessments of general education and major fields of study in undergraduate 
studies. To the extent that few states today specify the methods and measures to be 
used they tended to follow the Virginia rather than the Tennessee model (Ewell, 
1993) It would be wrong to conclude, however, that there is a predominant 
"model" of statewide assessmem policies. In fact, no two state policies are truly the 
same (Paulson, 1990) and few arc grounded in research on assessmem (Ewell, 
1988). 

Page 1 



ERIC 



Putting Students at the Center of Statewide Assessment 



The state government interest in assessment was a direct result of the concern of the 
National Governors' Association and the Education Commission of the States 
concern for the quality of the nation's schools. TTiree powerful ajid polu.cally 
ambit^us governors led the NGA report on education: Lamar Alexander, BU 
cTimon, and Thomas Kean. Alexander (Tennessee) and Kean (New Jersey) 
represented states who had taken the statewide testing aPP^°f > 
entered the White House, he continued to champion the agenda of the NGA, but he 
came to favor a more decentralized approach. 

Given our recem research at the National Center on Postsecondary Teaching 
Learning and Assessment, we see a more positive role for statewide assessments of 
student learning in higher education. If carefully cmfted, assessmem can lead to an 
Sp^vemnt in the communication and understanding between the academy and the 
pX Tuch a reframing camiot come at a better time, for the public interest and 
confidence in higher education is at a low point The public is questioning: the 
qua w of progrmns, institutions' ability to prepare students for the increasingly 
SompTex tLh^gical demands of society, faculty's credibility and time 
mZgement, and institutions' use of resources. This menacing situation can be 
3Ca threat to an opportunity. In this paper, we outline a role for sta «wi«ie 
^essm^n^ that augments and enhances, rather than conflicts and duplicates 
^r^^ic and in^tutional accreditation and provides for insututionally-crafted 
assessments of student learning. 

A role for statewide assessment 

The U S Constitution gives the states the legal responsibility for providing 
Sication taTe cie of Wgher education, states have delegated that responsibility 
^^vS^ of ways. TTm>fgh charters, states have ^ven the right to mdependen 
^tveSs and colleges to educate according to the mission and am^s of Ae 
^e? Sough the sL constitution, certain states have created state umversities 
(ef ^aSiia^Michigan, etc.) that are literally fourth branches of govermnem. 
So^; puMeges Ld universities were created by state statute ^"^0 
accomplish a specific mission and aims. Finally, many community;, junior and 
tSS «)lleges are a combination of local and state government. Like local 
schooU^^^^ community college districts have r«:eived local operating ^d 
Sing aJorit; to serve a specified region within a state to provide transfer 
Tuparional, remedial/developmental and/or community education prop^s and 
Ss In all cases, while the states have delegated the responsibility for 
prTvSg h gher educ^on to different kinds and types of institutions, they retain 
juTsdictL over the educational enterprise and have the authority to review and 
evaluate the quality and adequacy of education provided. 
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States generally have not taken a very active role in overseeing higher education or 
in determining its quality. Prognunmatic quality is often delegated to professional 
licensure associations, such as the Accrediting Board for Engineering Education 
(ABET) while overall institutions, quality has been left to regions accrediting 
agencies. However, where states have insisted on institutions developing student 
assessment plans, greater levels of effort and direction have been achieved m 
determining the impact of higher education on student learning (bwell. iVVi). 



What the Research Says 



ERIC 



Variation in student learning is greater wiihin institutions than between them 
(Pascarella & Terenzini, 1991; Ratcliff, 1993; Pascarella, et al., 1994). 
Consequently, while there are differences in student learning from institution to 
institution, the greatest differences are to be found within the institutions among the 
students. 

Consider this. After examining roughly 4,000 undergraduates in all types and sizes 
of colleges and universities - from research institutions, to liberal arts colleges, to 
community colleges - we found that students enrolled in community colleges 
learned as much their first year as their counterparts in baccalaureate-granting 
institutions in key subject areas, such as reading comprehension, math and cntica 
thinking. These findings do not mean that all students should rush out mid enroll 
in community colleges. Each college and university attracts a self-selected 
population of students. Rather, it suggests that those students who chose a 
community college showed comparable achievement to those enrolling m other 
forms of higher education. 

We found similar results when we examined African-American students enrolled 
in historically Black colleges and universities (HBCUs). TTiese students showed 
achievement in reading comprehension, writing, mathematics, and critical thinking 
equal to, or greater than, their African-American counterparts attwiding 
predominantly white institutions. Again, the lesson is not that all African- 
Americans should attend HBCUs but that those who choose to do so profit well 
from their experience. Such large scale, cross-institutional assessment affirms that 
the American system of higher education is woricing. 

Despite these similarities between institutions, great disparities exist within the 
institutions themselves. When we examined the formal curriculum students took, 
we found patterns of coursework taken by students who showed marked superior 
achievement When we examined purposcfiilly constructed collaborative eammg 
environments, federated learning communities, and cooperative learning 
classrooms, again we found significant greater gains in student learning and 
achievement. 
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Every college and university enrolls both students who learn a great deal and 
LveTopSgnkantlyd^^^ 

or do not profit from their experience. If those who do ^e^efi are bngh 
smdents to begin with, most likely they will emerge bright graduates but no bette 
rorAe r undergradtiate experience. If they are less able students they may nm 
compk their educational aims. Hie curriculum of every type of ms nmnon we 
coined appeared to be geared more to those above the mean (for that mst tut.on) 
3o Sose 4low the mean, which affinns our conviction that assessment works 
be^^ ::hen g^d to formativ'e aims. If we can id-^ify f ch ^^^^^^^ 
the most and why and which students are not profitmg from the r collegiate 
expenenre^dwhy.thenwe can leani from th^ 

With the focus on institutional assessment, most plans ask how well tfie institution 
r^ing and to treat students as an amoiphous mass in doing so. Since ^den^ 
come into our institutions with a great variety of interests, abilities ^^^^^ 
s^Tes. assessmem would be more useful if our efforts were centered on students. 

Putting students at the center means identifying those who profit from their 
S?^le studies, identifying the saiiem -benviromnents of cu^^^^^^^ 
^c^culum they encountered, and learning how these provided enlightenmen^ 
e^Rrent, and empowerment. We can learn from our successes and avoid our 
Ss by looking 4hm our institutions to see what worics for whom and why. 
niis. I submit, is the challenge that lays before us in the next decade. 



Putting Students at the Center 

While it is reasonable for a state to ask, "What benefits result from oj^ jvestmem 
Thkher education?", such questions have been followed by »nstitut^n by 
sSSn llyses of 'studentlsessment results ^^J^ ^^^^^ 

achievememadlhill institutions. Funding formulas and budget ^quests as we l as 
^ur dSntra™approach to assessment, have made mstitutions (rather than 
students) the primary object of analysis. 

Statewide assessment of studem learning should be focused on students. States 
S^e mSeTnvesmients in various groups of students. Most states can demonstrate 
Sc hi^er education resource allocation to rural students, urban commuter 
sLdeS tSitional college-age residential students, and certain historically under 
S«sent7groups in Wgher education (e.g., women, specific racial and ethnic 
XrS studenii). Withm each of these groups, thert, are students who show 
Sit learning gains and those who do not It is ai«isonable aim of ^tewuie 
Tes^nts to look formatively at each studem group m which the state has 
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Putting Students at the Center of Statewide Assessment Plans ^ 
invested to see who has profited and who has not. 

Consider two institutions within a single state. Urban university shows a 17% fir^t 
year to baccalaureate retention rate and low student achievement m wntmg, ma h, 
and critical thinking. Rural university shows a 40% retention rate and significantly 
greater student performance in the aforementioned areas of learning. When 
inferences in studem background are controlled, the results m learning and 
retemion are roughly equal between the two institutions The mstitutional 
differences were largely attributable to student differences: Urban university had 
more part-time and commuter students who tended to have higher drop-out rates 
and lower levels of achievement. It would be easy for a legislator or citizen to 
misinterpret assessment data presented institution by institution, concludmg that 
U ban provides an inferior education. Putting students at the center of statewide 
assessments alleviates this problem and highlights state investments by student 
subgroups. 

Another common misinterpretation has occurred regarding the tinie it takes a 
s^d nt to complete a degree. Legislators have been concerned that students seem 
to be taking longer and longer to complete a baccalaureate. Yet, it w^ the same 
state legislature in the 1950s and 1960s who created open accessinstitu ions to 
erle p'^-Ume, adult and commuting students. TTiese students f^quent ly must 
balance time for work and time for family with nme for bemg a student. They 

take longer to complete their degree. As the proportion of P^r^^-^me 
SmuL studenis rises among the total student population some legislator 
e^oriouslv have rtjached the conclusion that students are "lazy** and are not 
iTnSig^ntlytowanidegreecompletionor^t*^^^^^^^^^ 
oroviding an efficient and expeditious curriculum. Nine of the eleven western 
Sr^considering or have implemented state policies to penalize smd^ts who 
Sponger to complete their degrees, even though the time to degree statistics may 
Tskewed by the rising proportion of non-traditional students, due to the 
aformenetioned state level commitment to access and diversity. 

Another problem arises with transfer students. In urban students increasingly 
choose among institutions of higher education for mdividual courses. Then ^^he" 
S^eTamass sufficient credits, they fmd the most expedient institution m which to 
att^n their degree. We examined the transcripts of transfer sttidents from Clayton 
^College oTsuburban Atlanta) who had completed their baccalaureate degree 
a^eorgia State University. We found that they also attended Kemiesaw College 
AUaSunior College, DcKalb Community College, Emory Univereity. and a host 
oSr Stutions'ii the AUanta metropolitan Of M 
as transfers from Clayton State, 20 had never attended Clayton State (Ratcliff, 
Hotan & Jones, 1991). They were listed as Clayton students because that was 
S institution of «cord on their transcript ^^/^ ^^^'i'^'^;'^^';;^, 
withdrawn from Clayton, thereby never having had any significant educational 
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experience at the institution. Nonetheless, for statewide reporting purposes and for 
the purposes of admission to Georgia State, they had been regarded as Clayton 
students Whose students were they anyway? TTiey were their own masters. They 
were part-time students whose enrollment was being counted by several mstitutions 
simultaneously as they dropped-in one institution, then another, while droppmg-out 
of a third. Institutional assessments will not gamer a meaningful profile ot tnese 
studems' successes and difficulties, achievements and failures. Only by pooling 
assessment information and agreeing to some cross^utting mteria can we begin to 
accurately profile the growth and development of these students. 

A solution to such situations is statewide assessments based on studente, not 
institutions. Those assessments can and should have a formative focus (Erwin 
1993) and should illustrate how resources devoted to each major subgroup of 
students are paying off (Ewell. 1994). Allocation of resources can be made m terms 
of the proportion of any one studem group served by each institution In this 
mamier, institutional reports of statewide assessment results would highlight how 
the salient subgroups of students performed in their specific campus environment. 

Statewide Initiatives 

Initiatives are underway in a number of states to put students at the center of their 
^Sssment planning. As Serbrenia Sims has pointed out (1992). such smtewide 
assessments, in and of themselves, are not at aU new. TTie Pemisylvania Study of 
Student Learning, commensing in 1928. assessed nearly ail the college sophomores 
and seniors in aH the state's institutions of higher education. Hie purpose was to 
determine what the baccalaureate "amounts to in terms, first, of clear, available, 
important ideas, and second, of ability to discriminate exactly among ideas and use 
rem^iS in thinking" (Learned and Wood, 1938. p. 371). What is new are 
statewide initiatives that put students at the center of statewide assessment plans. 

The chief academic officers of the Oregon State System of Higher Education 
(OSSHE). under the leadership and support of Vice Chancellor for Academic 
Affairs. Shirley Clark, have met. discussed, and approved a fiameworic for a 
statewide assessment of student learning. In their deliberations, they decided to 
leave assessing the unique curricular aims of their institutions primanly to Ae 
regional and programmatic accrediting reports. TTie OSSHE efforte focuses on the 
common learning criteria currently used for admissions and enrolUnent reportng 
as a basis for identifying broad areas of learning that cut across mstitutional 
differences and represem key subject areas and cognitive skills to be considered m 
the statewide effort. Tlius. the framework incorporates assessment at multip e points 
in time (entry, midpoints, and exit), and muUiple criteria reflecting areas of learnmg 
represented iicrosVinstitutions. The areas identified included assessment of 
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retention and degree completion rates (to monitor the state s commi ment to 
rcces ) writing, math, science, social science, and critical thmkmg sk.lls. They 
decided To begh with a few areas of assessment (critical thmkmg, wntmg, 
retention), adding others in subsequent years of development. 

During this first year, faculty representatives identified by Ae P^ovo^ or Vice 
President for Academic Affairs have been meeting to identify key critical thmkmg 
S tSat could be assessed across institutions. OSSHE has been compiling 
retention and degree completion information. A new draft report that reports 
^sessmenTdata utili both qualitative and quantitative data on each salient 
student group is being prepared. 

Meanwhile, OSSHE has sponsored pilot assessmem projects at the various 

"nswithinthestatesystem. P'^^^ P-j^ ^t'^^orS ^3 
criteria, methods, and measures for assessment building upon Ae exemplary 
omc ces found a^ong the institutions. Institutions with pilot projects are being 
S to eZlne the applicability of their assessmem techniques to other member 
institutions in the system. 

The aim is to use the pilot piojects and the statewide conferences on each area of 
Sm^ to b^ assessed as a basis for selecting, trying out, and implementmg 
statw?de st^^^^^^^ Again, the focus has been on differentiating 

bt™lient subgroups of student ^ 

is succeeding and who is not Tlie whole effort is mtended to be formative, to assist 
L Sitions in imp«,ving teaching and learning -^to -s^t J^e^^^^^^ 
identifying where best to invest scarce state resources. TTiis effort places students, 
not institutions, at the center of the assessmem process. 

In Utah, the Regents' Task Force on General Education Assessment has identified 
lev te^i^g criteria that cut across the two- and four-year colleges and the 
^n^veS aSu, cuiricular and programmatic aims unique to smgle institutions 
Te^iHeftTAoseinstitutions toassessand^^^ Key knowledge and skills 
quantitative analysis, computer and information technology and 
L^SXtionshavebeendiscussedbyTaskForcesubcommm^^^^^^ 
oJTX in pertinem disciplines from across the state. Again, the focus of the 
effort is on students and student learning. 

Conclusions ^^^.^ ^^^^^^ p^l^r'T^^Th; 

SoiJSion, and higher education. States have the responsibility for Ae 
S^of h gher education, they want some evidence that they are making tfie 
righT decision when they continue to support colleges and universities and the 
Students who attend them. 
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In order tp give states greater understanding and greater confidence m higher 
education, statewide Ssessments can be constructed which highlight the 
performance of significant subgroups of students. Using ^J»dent outcomes on 
mutually-agreed upon criteria, student subgroups can be identified relative to 
performance. Such assessments can and should be based on muUiple measures. 
Using a formative approach, incentive funding can be directed toward those specific 
student subgroups and areas of learning where improvement is needed or 
achievement looks most promising. 

If we in the academy take an active lead and initiate discussions across institutions 
of higher education regarding common learning of students, we can take the first 
step toward putting students at the center of statewide assessments. By portray ing 
in quantitative and qualitative terms the success of commuting and part-time 
IS, we can help legislators, policy makers and citizens better understand 
students' motivations to attend college and the challeng<« they fece m succeedinj^ 
By illustrating the continuing performance of traditional college-age studente, we 
beCrepresent how they benefit from the collegiate expenence. In short, we 
can turn statewide assessment from a threat into an opportunity, and ,n domg so, 
c^fy the role of the state, the institution, and the accrediting body m assuring 
quality in higher education. 
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